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ABSTRACT 
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class of recognition problems, An initial section gives an intuitive model of frames, 
and illustrates a number of desirable features of such a representation A more 
technical example describes a small recognition program for the Blocks World 
which implements some of these features. The final section discusses the more 
general significance of the representation and the recognition process used in th* 
example. 
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I. INTRODUCTION 

How can we represent in a computer program the kind 
of know ledge people manipulate easily and effectively? 
One of the significant discoveries of artificial intelligence 
has been how computationally difficult are the elementary 
l:isks of vision, 1 ajij* uage f and common -sense reasoning 
which we perform continually in the course oT our everyday 
activities^ The techniques used by [At artificially 
intelligent programs of the past decade- arc simply not 
powerful enough to approach human performance over any 
wide range of tasks.. New mechanisms have recently been 
proposed by which the organisation of previa u*iy 
accumulated knowledge can assist active perception and 
understanding. Briefly^ the idea is that if there is too 
little campiiljitiuii time when a problem comes up, do some 
of the work in advance and keep the computed results 
available. This in itself is not an astonishing insight, 
though it does foeus Ouf attention on th* relationship 
among ten mediate perception,, understandings and long-term, 
real-world knowledge. It obviously should be easier 10 see 
something which has 'previously been, seen, and the queation 
becomes how to organize and « such previous espcrience. 

Mlnsky (197S) proposed a theory of "frames" aa a 
mechanism for representing kno^kilge in the computer. A 
frame ia a structure which represents knowledge about a 
very limited domain. A frame produces a. de script ion of 
the object or action in question, starting with an invariant 
Structure common to all cases in its domain, and adding 
ctrtatn features according to particular observations. Tha 
resulting description is slated in terms of a limited number 
of dtttriptora. A critical point is that the frame h as the 
unit of represented knowledge ia quite large. Rather than 
being on the order of a single properly or relation 
attributed to an object, it is on the order of a description 
of the Object with additional information indicating 
relations with other frames. Minsky'-s paper has evoked a 
great deal of discussion and interest in exploring further 
levels, of detail. It presents plausible and provocative 
examples af the application of frames to different problems 
in artificial intelligence- Since then, Wjno£rad [Chapter 
1), Bobraw & Norman [Chapter 5), Fahlman (1073), Rubin 
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(1^75), and others, have begun to disLinguisb the various 
theoretical and .technical issues often grouped together in 
discussions <4 fmcni'ft. 

Jn discussions of f ram.es> there is a tendency for 
.m:|i porters of the idea to have an intuitively satisfying 
iniet-nal model of the theory which they have great 
difficulty making precise and communicating la- others. It 
can be difficult to distinguish clearly between the concept 
of frames a»d previous ideas, or even io state the concepts 
precisely enough to evaluate them at all- In this chapter,. I 
attempt to prc-vuie an intuitive model which can serve as a 
foundation for wwrn precise statements. With ;lm intuitive 
example in mind, I extract some of the properties which 
are desirable in a frame representation. Next, I attempt 
to distinguish those issues which are relevant to 
recognition that is,, the problem of selecting one of a fixed 
set of alternate interpretations for a collection of 
observations. I present an example of recognition (in -a 
tiny world) for which actusll technical decisions fire made. 
In the last section h 1 discuss the simplified model of 
frame-based! recognition used by the example, and outline 
the limits of its applicability, 



II. IMPORTANT PROPERTIES OF FRAMES 

Some of the important prdE'^ties of frames us a 
representation :"cr knowledge ;ire listed below, to be 
discusied in more detail later. 

DttcripliW- A frame provides An elaborate structure for 
creating and maintaining a " description, A primitive 
element OF this description may be expanded to a frame 
when its internal description becomes of interest. 

fnjidn^LfjtLtirt.. This is '.he process by which the frame 
produces » description of the object being examined by 
aubs-titutin^ observed For predicted values. Features whose 
real properties have not been observed are represented by 

default values. 
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Pr#diclitir%- The frame's predicted description can be ua^ 
to funic the collection of observations for instantiation. It 
also produces the deFauk* which substitute for unobserved 
features. 

JiiSliftctilLuvt, Different features of the frame description 
have different amounts of confidence. Scimt acfr c\r.;?t 
observe lions, others are choices among few alternatives, ;md 
others are default assignments. 

Variation. The dimensions and ranged q! possible 
variation of each feature ape limited and specified, 

Correction. Anomalies may indicate that the current 
frame is not correct, and that a different point of view- is 
called For, The frame can analyze the anomaly to select a 
more appropriate replacement. 

Perturbation. For small changes in the observer ot I he 
observed, perturbation procedure Correct the description 
without complete recomputation. 

Trojisfonnalion. In case eF more significant changes, 
trans Formation procedure* prop^e f tames suitable for the 
new situation. 



A. Scenario 

Consider for a moment an intuitive description cl how a 
frame system might work in the everyday vision process. 
As you are walking through en unfamiliar house, you come 
to a normal interior-tvoe daor, open It. and walk through. 
At the moment that you. open the door, your (entirely 
reasonable) expectation* have already brought a "room'' 
frame to mind. There is no delay In comprehending the 
fact that yev sec four walls, floor, and ceiling, since you 
already 'fene™" that they would be there, even without 
having seen them,. Indeed, if these expectations had not 
been fulfilled, and you had been presented with, 5417, a 
seashore instead, you would exper LeiK6 ft sense of 
disorientation. Ygl have found a ro»m f however, and your 
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(mostly u neon scions) analysis continues. The window on 
the opposik wall is incorporated into the room description 
which is forming in your mind, very uuickly because you 
have available a number of prepackaged window 
descriptions, These descriptions UTC a]j£ frames in their 
own right, but will only be used as stereotypes unlets you 
direct ycur attention to them. A bed in the room causes 
t\w gesieril "room" frame to be replaced by a more specific 
"bedroom 1 * frame, in which a dishwasher it no longer a 
serious possibility. The visual information already collected 
by the "room" fra.me t however^ is stilL valid and It 
incorporated into the description within the bedroom frame 

Your attention passes over a clock near the bed and 
focuses, on the firenla.ee. The fact of it) existence and the 
superficial properties of fireplaces arc recorded in the top- 
level room frame, but another frame is activated lo record 
the description of the fireplace in detail, That information 
is extraneous in the room frame, and needs a context of its 
own, When questioned later, you will be able to answer 
detailed questions about the fireplace (perhaps noticing a 
subjective feeling of focussing attention on the firt:|il;ire 
and away from the rest of the room wh«n answering 1 ), and 
you will he unable lo say more about iIik flock iknn thst it 
was a clock mounted on the wall. Quite possibly you will 
recall it as having hands in splie of the fact that, being a 
very modern flock, it had none- 

In L-Lnistru.cl.ing the dft&erLntiori of the room., you would 
have verified in passing that it was a clock, perhaps by 
noticing the characteristic hour marks, and then allowed 
the stereotype description of the clock feature to provide 
the rest, This kind of self-deception by expectation is a 
result of the diligence of the frame mechanism attempting 
to extract a maximally detailed description from a minimal 
amount of input information. I use an example where the 
default assignment was Incorrect becaus-e there is less ilnubt 
in such eases that the information was supplied by the 
frame. In general, of course, such stereotypes are correct^ 
making it uncertain whether the information come from a 
default description or an actual observation. 
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B. Description 

A frame lias a small domain of e*pH'rlise and contains 
the knowledge necessary to create a description of an object 
in thai domain. Some know Ledge tells how to lake a set 
of observations and create a correspondence between those 
observations and the descriptive mechanism of the frame, 
Other knowledge allows the frame to predict some fealurr-s 
of the description after observing others, Transformation 
knowledge maintain! the description under small changes of 
viewpoint, ia avoid having to redescribe the scene, Wb can 
begin to make n distinction between the knowledge in a 
frame which is about the object being described (the 
expected features and the relations holding- among them), 
and that which manipulates the description in response to 
new observations Or changes in viewpoint. The latter kitid 
deals with the re La lions among descriptions and so could he 
considered as describing the properties of the domain and 
not of an individual object. 

There is an important point ty be made about Lbe 
reltti On between the local naturi> oF observations and the 

j.':>l:-i"; ii;:lii-e ;j' dc; ?L : f.".U. :..-,. Tin- (■!■::>::• ill"-,- imposed On 

ihc sensory inputs must be learned; it is not intrinsically 
present in what is se*n. Arty theory of representation of 
knowledge, and of recognition in particular, is trying to 
explain exactly how w* invpose the order we have learned 
through ei:perienifr onto the extremely varied an4 
disordered sensory inputs we receive. The important potrtt, 
then, is that any global knowledge contained by a 
description must have come from. the interna] 
representation. it crmld not come from Lhe observations 
alone. This helps to explain how prior knowledge is not 
only helpful, but necessary for understanding and 
perception. 

The description of an object includes a number of 
features of that object (which Winograd in Chapter 7 calls 
I MPs, for IMPortant elements) and the relations wnicli 
hoJd among those features. The description fllso specifies a 
limited set from which those features and relations are 
chosen, It is reasonable to ask. about the stove when 
thinking of a kitchen, hut in an. "office'" frame the stove i* 
fiot mentioned, not even to say that there is none. The 
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description may also contain inform a ti an computed fr^m 

observations, hut which h cs l- Lain] >■ not in ibe sensyry 
image-far exampLe, how many people can be served at the 
dining srooiii table, 

C. I ci* tan tia lion 

Instantiation is the proems by which a frame creates a 
dftscriptjon from observations of' m object in its domain- 
Part of a frame is s description schema which rushes 
buildmK a description a. matter of making a number of 
simple decisions and choosing from among limited seti of 
al res-natives. Most of the choice* involved in con strut; Li ng a 
description have already been made by selecting that frame, 
For example, wc kno*v that virtually all rooms are bounded 
by plane polygonal surfaces, and that almost a El of those 
consist of six rectangle*: four walls, floor, and ceiling. 
Thus the part of the descriptive process that describe* the 
ivaLk can usa a quick, simple test for large deviations from 
the expected four- wall description. If no deviations are 
noticed, the comply description of four pe-rpendi^lgr 
reclarigular walla can be used in the particular room 
description. This process., based on our experience with 
typical rooms and .the appearance of typical room-edges 
from the usual perspective;, makes it possible to verify a 
■mm pie* portion of a description in much leas time than 
would be rehired to generate it from Scratch. 

Our actual experience with rooms- comes mostly from 
particular kinds uf rooms: rooms in homes, offices, schools, 
and other buildings. . As we instantiate the general "room" 
frame we record characteristics winch could hdc-ng to any 
kind of -room. At the same time, however, the features we 
see. specify yrhich particular kind of room is hefore us, and 
bring tn the frame corresponding to that kind; of room, 
This isr th* process of refinement: within a frame of ' 
common characteristics, making decisions which determine a' 
parti cuSar and moie special tied frame in which to continue 
the description. For example, in the scenario, upon 
noticing the bed, the room frame becomes a bedroom frama 
which affects, some (not al]) of the teaming alternatives 
tn the description, 
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D, Correction 

In. mo«t common cases of recognition the identity of the 
object being described is rot initially known, so selecting 
the jumper faaqu to instantiate is part of the problem, 
lhe currant "best guess" frame attempts to create a 
correspondence between whal LI expects to see and the 
ibiffrvBtiotia actually available. If it rmLS into tin 
observation which is i^om-pa Li b l« with it* domain, that 
observation can often indicate a good replacement trams. 
For example* in attempting to recognise a large, four-lcflged 
animal, a reasonable- ^tieas would be that it is a horta. 
Small horns, however, are incompatible with a "horse* 
hypothesis, but stronpjiy suggest a cow, A single hirgo horn 
would suggest a unicorn. Notice, however, that much of 
the previously gathered information, such a* color and 
Location of various body parts, is valid in any of the three 
potential frames, and need not be obser^i] ;mew within the 
new frame, Fall 3 man [1373) H carrying on research along 
these lines, and I discus* these i&sues in more detail in 
Section HUE- 



E. Default Values 

When some feature of a description ha* not been 
observed, either becauae it Ls hidden or because it simply 
has not yet been attended to, the frame can still make 
quite an accurate prediction about that feature. This is 
true even if the object has not been observed at all yet, 
and the only basts for prediction is personal, IdLosvncratic 
esperience. For example, if I mention a bench/ball, J 
immediately conjure up an Eroacje of a particular ball with 
red and white stripes, These default values arc very weakly 
bound futures of the description in my "beachball" frame. 
It would take very little a^isoxy evidence to make me 
replace Ibem with better daU for a particular description. 
On the other hand, if 1 see a line drawing of a cube. I 
have a vary strong expectation of a hidden corner and three 
more- faces, and these expectations would be quite hard to 
replace. 

These- default values have two quite important uses. 
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The first is in guiding the process of recognizing and 
instantiating a particular deKripiion by suggesting vhat 
features to lool( for and where lo expect them. The second 
is to provide answers to questions for which cbservaLiems 
have n&i yel teen made, In this way, the frame reprnsuMUs 
our in due Live knowledge of the world as [-;;unr J u> previous 
experience- with that domain of objecU, This use oF default 
values also allows, * Frame representation to satisfy the 
"principle of co n ti n u a t Ly availahlr output" (Norman St- 
Bobrow K 19T50, which says that a fsrocejss should bu able to 
provide a result Oven when its analysis has eiol yet been 
completed. A lack of data or processing resources should 
produce a graceful degradation of the quality of the output, 
but not prevent results from being produced at- alL 



F T Variation 

A frame represents a certain limited domain, and hence 
a range of variation for objects which belong to that 
domain. As we saw in the room scenario, the features of a 
frame mny be frames in, their own right, embodying range* 
of variation. On entering a room, you are prepared for- 
cer tain typical pieces of furniture. A park bench or * 
diamond-encrusted throne would be outside the permissible 
range of variation in thi* frame, Such an anomaly may 
indicate to the correction mechanism that another frame is 
called For, When a number of features are near- the 
extreme of their ranges of variation, their collective 
unlikeliness can cast doubt on the applicability of this 
frame And initiate a search for further evidence which may 
result in a new frame, being selected. This is particularly 
clear in medical diagnosis, where a set of symptoms may be 
possible within the frame for disease X> but so unlikety 
that the doctor orders further tft*lS to search f«r a more 
plausible hypotheii a. 



G. Ferturfaiilicn and Prediction 

There are a number of different circumstances when a 
frame may be transformed or r-eplaced by a different one. 
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While sitting in a room, if I turn my head, I tting a 
previously invisible region into my Field of vision and lose 
a region from the other side, or T may move, changing the 
■vantage point from which I view certain features. These 
are relatively small changes which cause perturbations of 
the frame and the description it produces. 1 may 
experience larger changes by ir B lining inks another imib, 
requiring a prediction fl f w-hat frame I may need nest and 
repeating the instantiation process. These phenomena are 
net isolated, but lie on a spectrum which includes Looking 
from outside the doorway, or Lying on the floor and looking 
up. These intermediate ca*e* include moa-e common 
information from the original frame than Leaving the room 
entirely, *nd involve a mote drastic change to ihe frame 
than a perturbation. 

The common element to extract from Lh*se 
transformations is the idea of partially changing • 
description while saving those portion* which are still valid 
for the new version. A transformation in viewpoint does 
not take place spontaneously, it occurs as the result of 
some action (perhaps mental) with which we may he quite 
familiar; fji::i:l:;;r enough, in f;ict, to be represented by a 
scenario frame. An action, like an object* has a 
description, which often tfthes the form of a scenario. 
Frames may certainly he used to represent the kinds of 
variability scenarios are subfect to, just- at vision frames 
represent variability in Ttsual descriptions. Fart of th* 
Ir&me for a given action will he a prediction of its effect 
on Commonly associated objects and environments. When I 
atn walking;, the "walking" frame w[|l predict the change in 
the visual geometry of the enclosing roam. Conversely^ 
atrong visual ewes can be used very affectively, in movies 
for example, to evoke the sensation of motion. 

When the action in question forces most of the 
description to he redone, ' as when I walk from room to 
room t then the transformation consists mostly of proposing 
possible new frames. In a fAmiliur house I may be able to 
summon up a fairly complete and accurate description from 
memory, but in an unfamiliar house I need time to get my 
bearings. For small perturbations, however, such as 
moving slightly within the same room, the visual geometry 
Of the outlines of the room may change slightly, hut most 
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of the features will remain lite same, and appear in 

corresponding placea cm the wall*. If a piece of furniture 
looks substantially different From the new engle,, its own 
frame may require a transformation. 

Occlusion of objects en the background by those in the 
foreground can be explained by their relative positions 
within llie room description. I do nol believe, however, 
that pvuplv accurately predict such occlusiqna from their 
mental descriptions. On Looking at a scene, the description 
I gone-rate is not of the picture J see, I?u( of what I think 
that scene actually ia, I txm£ to conclusions about the 
global nature of the Sffr"* from evidence I bave> anil fill in 
with default values where I missed actual perception. 1 !. 



H- Extreme Anomalies 

An extremely unexpected observation, sgch as opening 
that door and finding myself at the sea$hor« h is treated in 
a mors serious way, My dumb founded ncss resulting from 
this occurrence is not only due to the time it takes to find 
a "seashore" frame, but I am a,]so Faced with evidence 
suggesting that previewaly accurate notions of continuity no 
longer hold. I do have sc«mc knowledge of geography, and f 
am filled with curiosity about how I was transported t<> 
the sea without noticing. I may decide to reject th« 
evidence and the attack on continuity by concluding that I 
am dreaming or hove gone crazy. Alternatively, I may 
retreat ba^k through the door and Iftck it, or in the best 

Kn'iirLi:: r —.■■-. I •■ :.m. pL i-Lj jii-. iL.!sl!:.j Hi:: :;n:h :" ;i :.'■:" ;<:r:s 
while I explore and gather more QbHrVttJom, The point of 
all this is that an extremely unexpected occurence calls into 
question not only the predicted frames that have proved to 
be inaccurate, but also thlt knowledge which led. the 
prediction process so seriously astray, Such experiences are 
saved and incorporated into newer versions of the faulty 
frames when Structural revisions become possible. 
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III, AN EXAMPLE: HLOCKS WORLD RECOGNITION 

Frames, then, have an intuitive appeal at & metaphor to 
explain how peapk organize and j-upt L-K«jit their knowledge. 
An obvious- question is, of course, whether this idea is of 
any help to us in representing such knowledge- in com pu Lee 
program.?. The nest example solves- a very easy problem, 
One for which the machinery developed is cpiite superfluous 
The hope, however, is I ha I the way such problems, are 
solved will provide valuable techniques to be used in 
solving larger, more realistic problems. 
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wedge 

with two 

visible faoM 



Fig. 1. Hie donufn. 

The domain shown in Fig. 1 conaiita of \'m<s drawings of a 
jingle,, unoccluded block, which can ba either a 
parallelepiped with three visible faces, a wedge with three. 
visible faces, or a wedge with two faces visible. The hlocka 
world has been used as a domain by a number of 
researchers, in different contexts [Winston, 19T5; Wintjgrad, 
1372), and ia rightly criticised as a "toy" world, lacking 
many of the important and complex prohlems found in the 
real world. Khtch of the difficulty of real world domains- 
cornea from our inability to express in, a computer program 
description* and distinctions wht^h urc obvious (though 
hard to verbalize) to a human heing- The blocks world, 
however, has vary clear descriptive- mechanisms, and it is 
*&Sy to find precise distinctions between two line draws tigs. 
In this . domain we can focus on the nature of the 
recognition process, and how the use of frames in 
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manipulating and representing descriptions can aid that 
praxis. The hope is thai a simple "toy" example will 
clarify phenomena which would he obscured bay other 
important (hiu separate) issues in a more complex domain. 

Five of the phenomena mentionad In (he previous 
section will be addressed by th P example of the block 
recognition program; -description, instantiation, prediction, 
correction, and transformation. The recognizer Instantiates 
ft description of the object it retHjgnizes f using its 
predictions to guide the recognition. When a conflict 
occurs between prediction and data, a complaint department 
associated with the frame selects an appropriate course of 
action, often a transformation to a new frame. 

What, then, docs the ro.ee>;; n iwi take as its input and 
produce as its output? The Sensory* world of this ay&lem 
consists of a body of data about tlte line drawing which can 
be interrogated by asking it questions which are very local,, 
in the sen^e that a particular part of the visual scene can 
be reached only by searching along a known edge from a 
vertex which has already be^n observed- An attractive 
metaphor is that of walking over a snowy field attempting 
to interpret a line drawing laid in pipes hidden under tn« 
SnOw. More precisely, the sensory world wnsists of edges 
and vertices, -which can perform the following operations 
upon receipt of th? appropriate massage. 

A vert** will deliver its type< the edge-s which 
terminate at it and the sizes of the angles 
between pairs of edges. This correspond.? to the 
resuit of a "circular search" in the neighborhood 
of a verlax. The type of a vertev is L, fork, or 
arrow. The size of an angle can be described as 
either flCute^ right, or obtuse. 

An edge will d*Uv*r its "other vertex" vpaa 

bHing presented with on* vertex. This 

corresponds to scanning an edge from on* vertes 
to the other. 

With this limited sensory world, ;ind even more 
impoverished descriptive system, the recognizer will attempt 
to re-cognise what it sees and provide a gJobal description 
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of thai object. It is important to recognise the difference 
between the sensory world which is available, and the 
descriptive mechanism vrhith creates an internal 
representation to be remembered. Even if the sensory 
world provided precise angle measurements, the recognizer 
Could Only describe them as acute, right, of obtuse, 
Similarly, people discard or blur many distinctions which 
are physiologically aval La hie to their a^nst-s, 

What is the description of a line drawing? A 
description imposes a level of organization on the 
observational data which is riot locally apparent in the 
scene itself. Si imply by stating that an object is, say, a 
cube, the description asserts that a certain collection of 
features appears in the scene and that many others do n&t, 
a fact which could he determined directly only by 
exhaustively searching the jschiu*. The description also 
provides a global structure lb the features which ia not 
apparent In the Lycal relations of the scene, Thus, looking 
at one comer of a cube, one may ask of the description, 
"Where i-s the opposite cornerj" The scene cannot a»swcr 
such a q.ttUtion, for it cannot define "opposite" in a way 
thai is meaningful to the cube. A third Function of the 
description is to include properties of the object which are 
inferred from the observed Features alo^g with the 
knowledge of its identity, auch as the volume of m cvb<i Or 
wedge. The description produced by this tKOgnli*t will 
fill only the first two functions, noting col tactions of 
features and providing a global relational structure, A line 
drawing will be classified according to type, arid it!; paTts 
will be accessible accord log to the global Structure of the 
abject it represents, 

The recognition problem in this blocks world domain is 
to select and instantiate the correct frame for the drawing, 
Since, however, Instantiation must begin . before selection 
can take place, the rf-rogckizcr must also evaluate observed 
evidence, predict subsequent observations, select a, new- 
frame when necessary, and save previously collected 
observations, 

Havln-g defined the problem, we can now begin to look 
At what the recognizer is. The recognizer consists of three 
"r.irii!!:, :.ii!!.- J:.ir Vie.-, type of objesl in !!:■■ :hiii.:i.".. Each 
frame is a program for enamhnng th# input data and 
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constructing a description oF Us type of block from that 
data. A frame Ems man}' of the properties of a description, 
in that it imposes its own global orgaoiiyjjon, on the 
observed dfttft and makes predict [mis. based on its 
observations along with its assumptions about the type of 
object being observed. An important similarity between a 
frame and the corresponding description is that a Frame 
will he a bit to answer questions about as- ye I ■unobserved 
portions of the scene based on its predictions. Thus, a 
frame functions, aa a complete (though possibly erroneous! 
description even before Us processing is complete. 

A frame, however, has additional capabilities which am 
not present (or necessary) in a description. It contains 
.•itriitsgy knowledge which -zi^ advise it r.:ri the best 
observdttuns to consider as it bulld.3 its description. It also 
has the ability to evaluate the observations for consistency, 
with the description it is attempting to instantiate, and to 
turn the process, over to a more appropriate frame when ■ 
fatal inconsistency appears, During the recognition process 
this description serve.* as a hypothesis about the scene 
which the frame is attempting to confirm or refute, When 
the hypothesis is refuted, however,, it is not pnly the- 
description which \i replaced by a belter alternative, The 
new frame aJ.Mf;. contains new knowledge About strategy, 
evaluation, and the handling of Inconsistencies in ways that 
ure more appro priate tc the new hypothesis. 

There. ;ir:- two distinct kinds of knowledge about the 
rr:il i.iT-i-;. r: F -ln.-.:.i; 1 1 n ■: J L - ;-. »■ . _:£.> •v:J:l- ::r.- ,-" h r\i\c(\ III :hn 
frame and i^hich guide the construction of the description. 
The first is kocal knowledge about the types of vertices 
which appear in the- figure, and how each vertex is 
connected to Its immediate neighbor. The second is 
knowledge of the global relations which hold among the 
angles in different parte of the drawing (see Fig. 3) F These 
global relation* allow an observed angle measurement in one 
part of the drawing to predict an observation in another 
part. Brttb kinds of knowledge serve the same role of 
predicting observations and guiding the recognition process, 
hut they interact M'ith observations in different ways, and 
the details^ of their representation in the frame are 
somewhat different. 
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A.. Rficngiijtion Scenario 

Let us follow a -Scenario of the recognition of a block, 
drawing,, in this case the three-face view of a wedft. 

Figure 2 shows (.he stages of the recognition process, witti 
observed datA indicated in solid Lines and hypothetical 
knowledge in dotted lines* The first drawing is, the Actual 
scene, with the vertices numbered in ihe ordtr in which 
they wi]| he explored. 

Vertex 1: We atari the recognition process by giving 
the program an Initial vertcx K which in this case happens 
to be an L-vertes, The initial hypothesis is that the Figure 
is a parallfrlefiiped, indicated by the dotted lints, in th* 
fiflyrft. Th* aingla angle measurement, a Lung with the 
ps rul 1 i-l cpijicd hypo thesis, predicts the sites of llio four 
additional angles indicated. 

Vertes 2; The second vertes; observed agrees completely 
with the hypothesis, which expected an arrow vertex and 
had a particular measurement jmLiri patcd for the left side 
angte of the arrow. The two other angle measurements 
provided by the arrow a] Low tht frame to predict every 
angLe expected in the ji.iral.lclc piped. Figure 3 shows the 
global angle relations which support this extensive 

-..:-.-.! i.:l;:.n. 

Vertex 3; This is an arrow vertex, which is the vertcs- 
typo predicted by the currant hypothesis. At IbU p-oitlt wo 
can see that the angle is loo small, and that the figure 
cannot be a parallelepiped. If the pru^i-iim had been given 
batter angle resolution, the angle specialist would ulso have 
noticed the error in angle and would hava complained to 
the frame. We are assuming, however that the system 
cannot discriminate welL enough, sto the angle specialist 
accepts the information as consistent, and the recognizer 
continues with a mistaken hypothesis. 

Vertex 4: The JVirln-vcrtes at the center of the figure 
also correspe-nd* Completely with the parallelepiped 
hypothesis. One complete face has now been observed and 
confirmed. 
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Vertex 5: With this observation, the parallelepiped 
hypothesis finally break* down. Tin' h-vertts specialist 
observes an unexpected 1ype oF varies a Fid complains' to the 
framer "I expected, an L, but got an arrow." The 
parallelepiped fr^me knows Unit this particular problem 
Lrnlic;jLi-s a Lr;ni»i ticm lc the three-face- view of the wedge. 
It then" PnaEyaes the complaining vertex and the data 
already collected to discover the correspondent between the 
cube and w'edge frames- which \vllL Li L L : . ■■ ■. p re viously collected 
data to be retained, finally, it executes, the selected 
transformation. 

Notice iome fancy stepping here. The m"H"* furled arrow 
vertex was an anomaly to the pa ralielr piped frames and the 
Information contained ill it could not be completely 
["■^•■■. ; .::; , :l by ''uv 1 ,-■.■•■ r i ■■ x 5pc"i:i :"l. Thus it was ignored, 
and the Irs ri-s-i lion to the wedge frame took place with only 
the previously known data. Once the new frame was in 
control, it could deal with the arrow vertex. The arrow 
rertffl, in effect, caused the recognizer to do a 'double 
take". 

Vertex 6: At this, point, with the three-Face wedge 
frame directing the exploration, there En only one re main in $ 
vertex, iind it completely confirms this hypothesis- Till 
frame El now f v tly instantiated, 



B. REpresentation 

A frame is built around a hypothetical description. The 
elements of thai description are represented by active 
program objects (called "specialists") which interact by 
sending messages to each other, Each vertex in the 
drawing is represented by a specialist in one of the vertex 
types: L, fork, or arrow. The properties of tlsat typ* of 
vertex are represented by the particular behavior of that 
specialist. A vert*-* specialist has puintors to each of the 
edges terminating at it. An edge is also represented by a 
specialist with pointers to its two vertices, This network 
of specialists connected with pointers represents the 
topological connectivity of the line drawing. The network 
makes implicit predictions by stating that iF a vertex 
specialist is satisfied with the real (observed) vertex 
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£GrrKS.po tiding to it, then a scan alfing one OF the *(lg*i 
shruild en noil nter another real vertex which will satisfy that 
corresponding vsnei specialist. Once an initial 

correspondence has bwn established between observation 
and hypothesis, this constitutes a prediclio-n of all the 
vertex types, and their connections throughout the Figure. 
This prediction is embedded in the structure of the frame, 
and CiKitnr>| be changed by incoming data, except hy refilling 
the hypothesis and replacing the frame with another one. 
New angle predictions., on the other- hand, can be Freely 
sent among angle specialists t hmu ghoii t the Figure. Tha 
relations among the angles in tit* Ihic drawing (Fig, 3) are 
represented by angle am.] relation spec tali E.I&, who 
eo-rnmuntcate pre<iktio:n4 and ohser\ r ationH among themselves. 
Ey this com.tnLiiuta.lj en, an angle observation in one part of 
the figure ean affect the prediction in a remote part of the 
Figure. The edges, the faces, and the block as a whole are 
also represented by specialists, sending messages to f-uch 
Other, whose bcba\ r ior directs the recognition and 
instaiitiation process. 




Fig. 3. Global angla lelationa in the partita!* piped frame. 
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C The IJii.sLi: Loop 

The bas-rc operation of the recognition process Is to 
select an observation unci evaluate it with respect to the 
predictions made by the Current frame hypothesis, The 
flow of control dtfscribfld here includes the i]i>r:sions about 
search strategy, sending observations to corresponding 
specialists for evaluation, and commoriicattFig' predictions 
and additional data between specie I ist-S, It is important Us 
notice that these design decisions can be changed 
irirlrnmilently. For example., the selection of the next 
observation can be made, in a different way without 
changing the real of th« flow of control. The rang* of 
flexibility of theae design decisions, will be the topic <iT tlic 
last section of this chapter. Since the frame consists of a 
number of specialists, each with Us own. behavior, the 
description of the normal flow of control will ul&o describe 
much of Ihf. 'u.;h?ivier of those specialists, 

(1) When instantiation begins, an initial observed vertex 
ia sent to the recognizer. Since the initial "cube" 
hypothesis is,, symmetrical, the wrrcspondence between 
hypothesis and data is set on by sending the observed 
vertex to an arbitrary vertex specialist of the same type. 
After this, the specialist for the entire block directs the 
instantiation. 

(2) When the bhi<ls specialist is told to. select an 
observation, it cycles through its faces, telling each in turn 
to select the observation. 

(3) When a face specialist is told to select an 
observation, it cycles through its edgea, telling each in turn 
to select an observation, If they all refuse, the face passes 
the refusal back bo the block specialist. 

(4) When an edge specialist is told to select an 
ohscrv&tion, it checks to see if it is in a very particular 
state. It can make an observation only if: a real edge has 
been observed corresponding to it und exactly one of Hi* 
vertex specialists at its ends has observed a corresponding 
real vertex. If this state of affairs obtains, the edge 
specialist performs the scan from one end of Ihe real edge 
to the other, and sends the newly observed real vortex to 
its corresponding vertex specialist;; otherwise, a refusal goes 
bath to the face specialist. 
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{$) When a vertex specialist receive* an observed vertex, 
it evaluate! the obse:r*atiQn against its prediction, by 
checking to see if the observed type h the same as what it 
expected. If not, a complaint goes to the complaint 
department (more on this in the next section). If the type 
is acceptable, the verlax specialist obtains the real edges 
and angle measurements which are available from the 
Observed verte*. Jt sends the observed edges to the 
corresponding edge specialist.;, and the observed angle 
measurements lo the angle spcdalista. 

(fi) When an edge specialist receives an observed edge 
from one of its neighboring vertes specialists, il remembers 
the ml edge, and the refit vertex at one end, so it can 
respond differently to future request's for observations. 

£7) When an angle specialist receives an observed angle 
measurement, it compares the measurement a i^Lnst o:»>- 
prediction it might have. A conflict, of course, results in a 
complaint sent to the complain l department If there was no 
previous prediction, the measurement will be of interest to 
:h2 s:jed;jii?,t fcalled a "^elation") which represents the 
relation .u:mng some collection of angles in the figure, so 
the r:bs*rvud mcasuremetit is sent on, An example of such 
a solution is that holding between the four angles of a 
parallelogram. 

(a) When a relation receives such measurement, il 
decides whether this measure ment implies some useful 
prediction. If so, it sends that prediction to the 
appropriate angle specialists.. 

(9) When an single speciaLisI receives such a prediction, 
it simply mm embers it for comparison with future 
observations. 



D, The Complaint Department 

A frame, has a Complaint department which receives 
complflints about violated expectations from the vertex and 
angle specialists. The offended special isl .sends :■. 
description of the problem from its own Lou;tl point of view, 
:iiul the complaint department, with its more global 
knowledge, must select the proper course of action. In this 
example, only the parallelepiped frame has a" nan trivial 
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compla i ft t department. There are three distinct responses, it 
can make. It can decide that the observed anomaly 
indicates thai the object being recognised ia ac-lyally the 
three- face view yf the wedge, far example, a»c3 that i.1 can 
determine the Correspondence between, whit lias a] ready 
been ohsei"v<jd and the data expected by the three-face 
wedge framr. Th-: some can happen to indicate a transition 
(.& the two- face view of the wedge, Tho third alternative 
{Fig, 4) is somewhat niosre interesting. The complaint 
department has enough. information to decide conclusively 
that the new Frame should be the three-face wedft, but it 
does not have Sufficient data to select Lb* correspondence 
between the old and the new frames. It Cannot decide 
which face- will be. the triangle. The solution adopted in 
this reco[;nj&cr is to continue the recognition process, under 
the old hypothesis (now known to ho mi sta ken) fc tinder the 
assumption that the next complaint wilt be ahle to setlle 
the question. This decision is based on knowledge of the 
domain which assures the recognizer that no important dati 
will be lost white working under tins mistaken hypothesi*. 
I do not address the question of how such knowledge can 
be automatical iy acorn red from evperience. 




fig. i. Th*j RrJlhi.g'UQu.a iruusittoii.: ihc framfi cannot predict 
which £:d« wit] hs th.fr trlangJo. 

Table I summarizes the process. :w which the complaint 
department deals with anomalies and seleets the new frame.. 
The alternative "continue (three-face wedge}" is the c**« 
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di^usaed immediately above. The complexity of the 
complaint d-epnrtmttit h a result of the number of 
compLaittU which <ife meaningful, and hence of Hi* number 
of aEtenitta frame* known to this frame. Thia tabic does 
not show the fairly elaborate decision procedure for 
determining the correspondence between the two frames 
before the transition cati actually be executed. 



TABLE I. 

The Complaint l>tpirlmcnt 



Verity specialist 

expccind arro*, cat L =o two-tea wcd S * 
expected L, fit a/iow «J lhiee-.fa.ire weilc* 

Angle Larger tban uxpecleil = -> ihrot-Eace Wedge- 

AngLe artiaJLej- than expected: 

Lft Jj vCftlfA ==? tWtt-fctfe wedgr 
1ft A1t<5w vertex: 

full ample =='? continue (three- Fac* wedfft) 
biAv angle: 

Observed L v*rt±x in that f-ace **> (.wft-face ^Kl^e 
elac ") continue (three-face wedjfl} 
ill fgrk verte* =r> '.hrro-r*^0 wL'Jue 



E. The Transition 



Once an anomaly has refuted the- parallelepiped 

hypothesis, and a more appropriate wedge frame has been 
Ejected, the problem remains of actually performing the 
transition. The simplest solution would be to start over, 
ignoring previously collected data except to indicate a 
different frame to start with. This Jorm of recognition is, 
a blind, back-ta-acliing search through a apace of line 
drawings. One gr>a] of thia example, however, is. to show 
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how frame-based recognition can exploit the similarities 
between different, line drawings to preserve observations 
eoltecled under a mi.s taken hypothecs. At the vrry least, 
!"•■ -Ktual oliAcrvatictj.-i r,f edgei and vertic-.rf. :.mi f.f rii=ppfi:3 
from the old description to the new one because the 
deflations of adjacency unci con nee Li v tty arc shared by all 
frames hi this domain. In favorable circumstances, tutflier- 
leveL descriptive object, such as a parallelogram face, will 
rejflAin valid in the new frame without disturbing their 
internal structure. 

The transition from the parallelepiped fr-jiinc to the 
three-face view of the wedge has those favorable properties. 
The differences between the two deserip Lions nro confined 
to changing one parallelogram face to a triangular face, and 
adjusting the angle predictions. To accomplish this 
transition, the parallelepiped frame replaces the collection 
of specialists which represent one parallelogram face with 
another col Lee lion For a triangle. It transfers whatever data 
has already been observed to the corresponding new 
ipeeial is ts, notifies all cotKemed neighbors of the change, 
and the displaced parts of the old descrtpLion disappear' 
The internal structure of the neighboring fates changes 
only in accepting a new pointer, The angle predictions also 
vanish, but new predictions are solicited from the angle 
specialists. 

The transition to the two-face wedge ia quite different, 
however. The change here involves much more extensive 
changes to the structure of the description. Just as in the 
other transition, there is a correspondence between . the 
representing special ista in the two frames, but in this case 
apeeiuliats who correspond may not have the same behavior, 
Fates which had two neighbors' now have only one; vertices 
which expected to be arrows will now be Ls; and jis before, 
the angle predictions become obsolete, In this ease, aLL 
that can be salvaged From the old frame are ttie actual 
observations, including the connections between them. 
These _ observation* are transferred to corresponding 
specialists in the two-face -wedg^ frame, which incorporates 
its own higher-lev&l descriptive structure. There is still an 
important saving in observations to be investigated, but not 
a? much program structure can be shared between the two- 
face wgdge and the paralleleptped as was possible between 
the parallelepiped, and the three-face wedge. 
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F". The Implementation 

This (.'sample was first programmed and! hand-simulated 
in ACTORS (Smith & Hewitt, 1074). As the itl^sis 
continued to evolve, a workirsg 1 implementation in 
SMALLTALK [Kay. 1974) v. as written and debugged in less 
than two weeks, The ease with which the concept could be 
trans Eated into a working pf&jjram. is primarily due to the 
Elavil ieiti u 1 1 i i cs- of these two I anguages . Both ACTORS and 
SM AM, TALK evolved lYnm the ideas in SIMULA (Da hi & 
Hoare n 1072), and are what might be called actor languages, 
as opposed to function ^t procedure lati^noKes tike LlHF or 
ALGOL. An actor is a procedure which can maintain ah 
internal state between invocations. Actors communicate by 
sending messages to each other, and are not constrained to 
send messages for control) only up or down a fun^ti en-call 
hierarchy. Allowing an actor to maintain an interna] st-nte 
make* it passible for the variables which are intuitively 
associated _ with a conceptual object to be associated 
directly with the corresponding' program object, 

A certain amount of confusion is possible between the 
different types of instantiation in this exampLe. A 
specialist representing a feature of the lino drawing (for 
example,, an arrow- vertex specialist) is. written as an actor 
which maintains a certain amount of internal slate, and has 
a certain behavior in response to particular messages. The 
parallelepiped fr.-i.mc contains threes copies of the ai-row- 
verlex specialist, each of which is an instance of the a.etOr 
mentioned above. These three instances are not identical, 
but can be distinguished by which other specialists they 
bav« as neighbors. The F>:i:;j]kkpLped tram*, -lien, is a 
program which consists of several parts, some of which 
aha rt program text but have different internal states. This 
frame-, is then provided with a. source of observational data.. 
Instantiation of the description is the process by which the 
various parts of the frame establish a correspondence vrith 
observational dfltft- To add further to the confusion, we 
can imagine a scene containing two unoccluded blocks, for 
which we make two eopies {instances) of the entire 
recognitor, so that separate frames can be instantiated, 
result lng in two independent descriptions, This third case 
seems to have no theoretical interest. 
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IV, WHAT DOES THIS ALL MEAN? 

Let us step back now and see what significance this 
example has in the larger enterprise of representing 
knowledge for; recognition. The overall structure of the 
recogniier has some applicability to other domains in which 
greater cwpreEsive power is required of the descripiivi* 
mechanism. In the following sections, I discuss the gftiit!r,n] 
Wntlusions which can be drawn a bruit the descriptive 
mechanisms- used, and shout the interacting module* "which 
supervise the recognition and instantiation proeeas-fts. Other 
domaina which have been inveati gated in some depth, and 
from whkh 1 draw esamples,, are medical diagnosis (Rubin, 
1975), and electronic circuits (Sussman, 1979), These other 
domains can show features which fit into the framework [ 
have developed, but which do nr>l appear in the blocks 
world. Whore possible, I point out the range of 
applicability of _ this framework for recognition, and give 
examples where it doea not apply. 



A. Representing the Hypothesis 

The block recognizer uses three method:; to represent 
hypotheses about line drawings. They ate: 

* the vertex -specialists, which know about a particular 
typ* of vertex to which they expect to Cor respond; 

■ the network of neighbor pointers,, which links the 
edge- and vertex -specialistE h and nonKUimrphLcally repreaeots 
the Connectivity of th^ edges and vertices in the drawing; 

* the angle tpaoiflJistB, which represent . the global 
relations among the angle measurements, and actively 
communicate predictions about particular angles. 

This division of representational effort works in the hloefea 
domain because a clear distinction can hs made between the 
different properties to he represented- There are strictly 
Jocal features (the vertex types), fined global relations {the 
connectivity between vertices and edges},, and predictive 
global relation; (th* angle relations), 
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Certain other domain?, fit into the same descriptive 
framework so thai this distinction between local and £ total 
feat urea, cm be clearly made. A good example of this is 

the domain, of eleetttoaici circuits, where the connectivity 
and local properties, of components must also be represented, 
and global relationships .lastong curi-nut and vol tare 
measurements at different points can bn> predicted. A less 
geometric example with thi same logical structure might be 
representing the time course of certain diseases, where local 
specialists are able to recognize particular symptoms, the 
network of connections is a partial time orderittg of event*, 
and the global relAtiona- may be among the different 
measurements of a varying quantity, such as blood pressure 
Or while blood cell count. 

There are, of course, many domains where the 
representational structure described in this example does 
not clearly apply. This "Es particularly true when features 
are not as discretely separable as tli^y are in the blocks 
world- For example, in medicine it can be important to 
describe the onset of a certain symptom as "insidious", or 
otherwise speeEfy an indefinite time interval which can 
overlap with other events. Notice that we are not simply 
specifying an interval whose enrtpo-tnts are discrete (though 
Currently unknown), but rather Jtn interval which fails to 
possess definite endpoints. The netwurk re presumption 
described above I asks the expressive power to deal 
adequately with this phenomenon. 

B. Manipulating the Hypotheses 

In the previous si-ction, we saw what kEnd of expressive 
power is availahte for representing hypotheses to this kind 
of recof.Tmer-. Now let us consider the structure provided 
to maculate those hypotheses. It consists af four parts: 

* a module to select the nest observation, to conaEderj 

' a module to evaluate the observation, comparing it 
with what was predicted; 

a module to serve as a complaint department, deciding 
what to d(? in. response to an observed, anomaly; 
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* a_ module to perform the transition to a new frame, 
preserving hi much as possible of the old information. 

These "modules." do not rorresjjond to aeflrcgated piecea of 
program in the block recognizer, hut are design units whoso 
implementation is likely la be diatri bated among the 
specialists which comprise the- frame, 

In, the following actions, we- will famine these modules 
individually and see what range of Lfliitvior can he opened 
of them. TIib important question* to ask of e*S<fh one are: 
What La it asked io do? What knowledge can it consider? 
What answers can it give? This modular-Lied view of th^ 
recognition process also has ita limitations, again because of 
the _diwrBte i structure of frames Linked by explicit 
transitions, Thia simplified vinw c: imns.n'mon is Lushm.) on 
the assumption that recognition proceed? by adopting a 
single "best guess" hypothesis, and modifying it to a better 
One in response to an unexpected observe Hen. There is. no 
provision for unterlaining several different hypn theses at 
once, or for Leaping to an unrelated frame where »a explicit 
Jink giuti, There are also important questions abont 
sharing knowledge among distinct frames which are not 
addressed in this domain. 



C. Selecting the Nest Observation 

This module decides which potential observation would 

be most useful at each paint in the recognition process. 
One* it has selected one, it sends the observed data to the 
appropriate specialist to begin the evaluation. The 
interesting thing about this module- is the range of 
information it can consider,, and where it obtains that- 
information.^ In the block recognition example a particuLar 
set of c&nsidera Lions is designed into the selector* so jt 
does not answer the questions below E ach time it makes an 
observation. Doctors* on Lhe other hand, fire trained to ask 
these questions explicitly in the course of a medical 
examination. 

Given what has already been observeil which alternate 
hypotheses ara the most likely? (j.a, ■ for differential 
diagnosis) 
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* The frame uses, observed data to refine its predictions 
and the description it it producing. Which observations 
would be most ^reductive- at this lime? 

r The [>ritg"matic context of this, recognition set m filter 
certdEn parts of the description more useful thun ether*. 
Which are these? 

* What costs fe-F- pain, risk, money, doctor's time) are 
associated with potential observations? 

There ai*e, of cour-sa, seme cases where the re! a Live 
LriifwrtiiJite of these- factors may he decided once and for rill 
and designed into the selection procedure, and aci-nirs wln.-m 
the situation must he actively and frequently reevaluated. 
Differential diagnosis in forma ti on may be requested by the 
complaint department in eases where an imomaty has been 
observed, hilt a unique replacement hypothesis cannot be 
selected. 



n. Evaluating |ht Observation 

This evaluation is a point at close contact between the 
representation and the manipulation of the hypo thrift- The 
frame checks an observation against its hypothesis, Asking 
whether that observation is consistent with the prtdktcd 
description. The discussion of representation above 
illustrates the local nature of this evaluation in the block 
recogniaer. The appropriate verleji and angle specintists 
each cheek the consistency of lh* new information with 
their expectations. The complexity lies in the range ol 
potential results of this evaluation. in the block 
recognizor, only the first two of the following possible 
reactions can occur, 

* The observation is consistent with the hypothesis, 
perhaps providing additional information to be absorbed by 
the framei 

* It is inconsistent, refuting" the hypothesis, and the 
specialist sends a, description of the problem to the 
complaint department. 



190 Hen jam in J, Kuipcrs 



* It is consistent with, the current hypothesis, hut 
&.ing3es nut a special case about which more knowledge is 
available. 

* El, iu isolation* is. consistent with the current 
hypothesis,. th.au.Eh near the edge of the range of variation. 
However, anough other observation* are .also near the edges 
of their ranges of variation that the Irani* becomes 
suspicious and. complains l.o tliH cumplaint department. ' 

The third, or "further specification " link between frames 
provides additional information which allows more detailed 
predictions or he tier selection of observations^ The fourth 
possibility allows suspicion to he cast on a hypothesis, as. it 
'; !.■:■■:. -mi-:: more md more unlikely, ■:.•-• :<i ['..-... if :, i: \-..\y ^nnr 
he conclusively refuted. It may nonetheless be replaced hy 
a better alternative, 



E, Selecting a New Hypothesis 

This module, the complaint department, is given a 
de&cj*i|ition of the current complaint (and perhaps 
Hmemben past Ones], and is asked to select a new 
hypothesis, In Hir block recogniier, most of the possible 
anomalies simply specify unambiguously the frame which 
should replace the current one. As we saw abova, however, 
there are cases in which further information ia necessary to 
select the correct orientation for the new frame. In either 
mode, the complaint department must possess knowledge 
about which alternate hypotheses are available. In most 
cases of practical recognition these decisions will bo reduced 
to simple tests of the observations, just as. in the block 
recogniaer, rather- than active problem-solving- during the 
recognition process. The Speed of frame- based recognition 
depends $n the assumption that the number of potential 
altemati-ves in a domain is manageable^ and that most 
anomalies clearly suggest alternate hypotheses. 

The eventual answer provided by the complain I 
department should be a new frame to replace the 
.complaining one. Some of the potential courses of action 
leading: to this result arei 
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* the anomaly may simply specify a new hypothesis to 
replace the old] 

* there may be previously collected irpFomation which 
cart be reexamined in mope detail to decide between, 
potential new frames;, 

■* tKe complaint department may request a particular 
observation For differential diagnosis from the module 
which selects the observat i en si 

* iT the anomaly is minor, or there Are no food 
alternsLtive& h the current from*! may just remember the 
problem and continue under the old hypothesis, hoping that 
further observation will illuminate the situation. 

The complaint department is also involved in 
representing the frame's range of variation. Each feature 
oF the frame description has its own range of variation 
which it wjli accept before complaining. The' complaint 
department may then decide to disregard certain, c^m plaints 
or accept excuses under some circumstances. A frame 
system could be L lev? that all dogs have tails, hut admit the 
possibility that a dog without a tail could still be a dog, 



F. Translating Knowledge- to thtt NVw Hypothesis 

At thisi early, somewhat speculative stage of research, it 
is considerably harder to generalise about the transition 
procedures than it is to talk about the other parts of the 
recogrtiznr. The other parts of the recognition process 
rfeppuEt largely on the properties of the demaiu; the 
transition depends on the structure of the description. 
Since that structure is one of the goals of Out research, 
any conclusions drawn From it are necessarily tentative. 
Another caveat is that the btoel« world domain was 
deliberately chosen to minimise the complexity of the 
descriptive and expressive problems to be encountered. 

As I mentioned previously, the hierarchical structure of 
the description is important in determining how much can 
be saved in replacing one frame with another. When a 
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large, self-contained substructure such as a parallelogram 
face lb esie nil ally the same in the two descriptions, U is 
natural to preserve it as a unit rather th;,n reconstructing 
il in the new fratn*. Even mora than this is true in the 
trenail on to the three-face wcdgei only g few pari* of the 
top-levd description need to be- cha,^ott- The rest of the 
description remains the saint. 

In making the transition to (lie two-face wedge, the 
higher structures of the two descriptions are quit* 
different, 40 less of the old description cart be preserved. 
The interpretation of the observations remains the same, 
however: if two parts are considered connected hy the 
parallelepiped frame, they are connected in the wedge 
fr-Aino, ;ind the terms in which they are described are the 
same. Thus when the recogniser reality u Ls looking at a 
wedge, it can remember what it saw when it thought the 
object was a parallelepiped. Even when the higher-levsl 
descriptive structure mutt be replaced, the recognizer need 
not Look again at features it haa already observed. 

Here again we see an example where we are helped oat 
hy the good behavior of the domain, or at least of our view 
of the domain. Even when the frame change, the 
interpretation of the observations remains much the same.. 
This need not he true in domains with segmentation 
problems. For esumpla, in speech recognition, changing the 
interpretation of one segment may affect the boundaries of 
the segment, requiring changes whuh rippLe outward to 
neighboring Hypotheses. A different set of techniques is 
required to state and evaluate hypotheses ahout domains 
where segmentation is an important problem. 
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V. SUMMARY 

In this chapter we presented the idea of frames in a 
very intuitive way f outlining a number of desirable 
features- of a representation for knowledge, and illustrating 
them with a specific example from the blocks, world. A 
frame is a specialist in a small domain. U Contains the 
knowledge necessary to create a description of an element 
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of its domain from observed data. The features of auth a 
description may he fntmes in Ih-e-ir cm-n right, reprinting 
a f*n£e of variation permitted in (hat domain. The frame 
for on object cjin have associated with it fram** fur actiona 
which commonly off eel that objact p so that predictions can 
be made about required ftiodif ieations to (.he description. 
The frame is capable oF predicting unobserved feat ores, and 
of uainj [ircvioua observations to rflfinc its prediction*, 
Theae predict] ana can guide the recognition process, and 
^ 1 1 - ■ : -. - 1 -; J - ' ;i 1 1 ■- wc rs to questions befor.' Unit :..: u"!-::', i.- 
complete, An observation which ia inconsistent with the 
frame's expectations can SLLgp-s^t a better frame as a 
replacement. Mu*h, of the partially constructed description 
can be incorporated into the new frame, which continues, 
the recoefnicitn process. 

It ia imparl ant to recognise the value of the intuitive 
mftdel presented above. In a sense it is a "wish (Est" of 
desirahle properties for a representation, out it is a list 
compiled with ths pre b] cms of eff^chive com pot ability in 
mind. It will he many years before the- t^chnica] pi-nblems 
implied by a frame theory can be precisely atated and 
solved. Such intuitions are therefore all the more 
important far providing a context in which current research 
can be viewed. 
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